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and retention rates following participation in developmental 
programs. This section also presents a case for developmental 
education aud outlines miscellaneous trends. Finally, chapter V 
suggests areas for future research and evaluation, focusing on 
testing methods, follow-up performance of post-developmental 
students, and cost effectiveness of programs. (HB) 



ED 238 471 

AUTHOR 
TITLE 

INSTITUTION 

PUB DATE 
NOTE 

AVAILABLE FROM 



PUB TYPE 

EDRS PRICE 
DESCRIPTORS 



ABSTRACT 



*********************************************************************** 

* Reproductions supplied by EDRS are the best that can be made * 

* from the original document. * 
*************************************************************** 



9 

ERLC 



Is Developmental Education Working? 
An Analysis of Research 



By: 

Hunter R. Boylan, Ph.D. 
Director, Kellogg institute 
Appalachian State University 



Editor for the Series: 
Harold N. Hild 
Northeastern Illinois University 



A Research Report Prepared for the National Association 
Remedial-Developmental Studies in Post-Secondary Education, 



Spring 1983 



Is Developmental Education Working? 

An Analysis of Research 
Written by: Hunter R, Boylan. Ph.D. 
Director, Kellogg Institute 
Appalachian State University 



The National Association for Remedial and Developmental 
Studies in Post Secondary Education 



First Edition 1983 



Copyright? ma 



4 



CONTENTS 



CHAPTER ONE 

AN INTRODUCTION Page 1 

CHAPTER TWO Pay© 9 

CHAPTER THREE 
RESULTS Page 13 

CHAPTER FOUR 
SUMMARY AND COMMENTS Page 25 

CHAPTER V 

FUTURE RESEARCH AND EVALUATION ISSUES .. Page 37 

CONCLUSION Page 43 

REFERENCES Page a 5 

APPENDIX I Page 49 

APPENDIX II Page 51 



ERJ.C 



IS DEVELOPMENTAL EDUCATION WORKING? 

AN ANALYSIS OF RESEARCH 

By: Hunter R. Boy Jan. Ph.D. 
Director. Ketlogg Institute 
Appalachian State University 



» CHAPTER I 

AN INTRODUCTION 

Whenever a person is introduce j to a layman as a developmental 
educato . hr the inevitable next question is "What's a developmental 
educator^' The usual response to this question is that a develop- 
mental educator is " someone who works with underprepared 
College students" And there the matter is often laid to rest. The 
layman now thinks he knows what developmental education *s all 
about The developmental educator, on the other hand, is reason- 
ably certajn that his rOle has been misunderstood In most cases, 
the developmental educator is right Neither he nor his role nor his 
students are likely to be understood by the layman nur. frequently, 
by his colleagues in academe This, of course, is one of the more 
frequently heard laments among practilioners in the field -■ 
"Nobody understands what we re trying to do hr Part of the reason 
for this, however, is that developmental educators have yet to 
articulate clearly what it is that they are trying to do. 

In a field that includes instructors of writing, reading, study skills 
and mathematics, counselors, instructional assistants, lab 
managers, and program directors, basic skihs programs, remedial 
programs, learning assistance programs, and developmental 
programs, this articulation problem is not Surprising Everyone 
involved tends tu look at developmental education from their own 
particular perspective Even those practitioners working in 
comprehensive programs offering a variety of different services 
tend to view developmental education from the perspective of their 
own campus and students The nomenclature used to describe 
programs, the types of services offered, and the characteristics of 
students served also tend to differ from place to place and program 
to program 
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All this ts further complicated by the fact that developmental 
education f$ a comparatively new field m postsecondary education 
While services for underprepared students have been common to 
college and university Campuses for over a hundred years (Maxwell* 
1979) the idea that such services and the personnel who provide 
them represent a 'professional specialty" m postsecondary 
education *s a new one In fact, it is an idea that is not yet fully 
accepted withm the academic community 

Complete acceptance of the field, the personnel who work in jt, 
and the students served by it, has been delayed for several reasons 
One 0* these has to do with a lack of definition and unified termin- 
ology in the field Another j s the lack of research indicating that 
developmental education actually does what it is supposed to do. 

These two oroblems are interwoven in that the Jack of a cohesive 
definition of developmental education makes it difficult to measurp 
the outcomes of developmental activities We cannot adequately 
assess that which we have not adequately defjned A necessary first 
step m measuring the effectiveness of developmental education* 
therefore, is to establish some definitions of what the field is and 
what it is supposed to do 



Developmental Education: Towards a Definition 

Although the field has not been adequately defined m the liter- 
ature, a great deal has been written about the types of programs that 
tend to be included m the field Much of this writing hasfocussed on 
the issue of remedial versusdevelopmental programs Roueche and 
Wheeler (1973. p 223) for instance, Claim that remedial programs as 
designed to remove L student deficiencies in order that the 
student may enter a program for which he was previously inelig- 
ible " Developmental programs, on the other hand, are concerned 
with " skills and attitudes and may not have anything to do with 
making a student eligible lor another program " 

K Patncia Cross (1976- p 31) descnbes the dilferences between 
remedial and developmental programs in terms of their purposes In 
her view, L1 tf the purpose of the program js to overcome deficiencies 
" then it is remedial If, however, the program is.designed to 
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develop the diverse talents of students, whether Academic or 
not " then it is developmental 

Both definitions have merit as far as they go They define pro- 
grams, however, rather than the vast range of endeavors currently 
related to the field of developmental education A more compre- 
hensive definition is needed and thai definition should begin with 
the acknowledgement that the field of developmental education is a 
professional specialty within the larger field of postsecondar/ 
education It has many of the same characteristics of any profes- 
sional specialty in education and should be recognized as such 

Professional specialties in education are generally characterized 
by the following 

1 Practitioners serve an identifiable Chen! population 

2 Some specialized training or experience is required in order 
to serve this cheril population 

3 This training or experience is based upon research literature. 
dntJ theory unique to the field 

4 Accepted standards exist for practice and these standards are 
maintained through licensure ccrMjca'ion or accreditation 

5 Professional associations exist to serve and support those 
who practice the professional specialty 

6 An identifiable mission exists whtch is accepted by practi- 
tioners in the field 

Although developmental education *s still emerging as a pro- 
fessional specialty, the field does have most of these character- 
istics Those who work m developmental programs of any kind 
usuai'y serve a specific target population This population gener- 
ally consists of students on a particular campus who, for one reason 
or another need to learn new skills or further enhance exjshng 
si ills 

It is rjrnerail/ acknowledged that the practice of developmental 
education regimes some sort of s KXiahzed training or experience 

Er|c 3 , 



Personnel are no longer selected at random for developmental 
programs Some combination of graduate training or professional 
development activity or experience is usually required of those who 
work in developmental programs Furthermore, a growing number 
pi graduate institutions have established programs to train 
developmental educators Appalachian State University. Gramulmg 
State University. Lehigh University. Murray State University, and 
North Carolina State University offer graduate degrees with areas of 
concentration in developmental education 

Since the late i960 s. the body of research, literature, and theory 
relating to the practice of developmental education has increased 
dramatically Prior to 1968. few pieces of literature focussing on 
developmental education could be identified Since thai time, more 
than two dozen books and a multitude of articles, monographs* and 
research reports have appeared In addition* at least two profes- 
sional journals ejusl to provide current information to practition- 
ers -- the Journal of Developmer ta! <£ Remedial Education and the 
WCRA Journal This growing bjdy of literature forms the basis for 
practice in the field , * 

Although professional licensure, certification, or accreditation 
procedures have not yel been established, plans are underway to 
implement a national certification process for developmental 
programs through the National Association for Remedial, Develop- 
mental Studies in Postsecondary Education jNARDSPE) A process 
for certifying developmental education specialists currently exists 
through the KeJ'ogg Institute for the Training and Certification of 
Developmental Educators 

A variety of national and regional professional associations exist 
in the field of developmental educaiion NARDSPE is the largest of 
these and thy Western College Reading Association (WCRA). 
although regional »n focus, has been serving professionals in the 
field since the mid-1960 s These assocations are joined by a host of 
state anc 1 regional associations serving and supporting practi- 
tioners 

While debate on the mission of developmental education con- 
tinues a consensus settfns to be emerging in the literature and 
among tedders m the field The emerging mission of developmen- 
tal edu *lion would seem to include the following components 
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• Promoting educational opportunity by training underprepared 
college students *n the skills necessary for success 

• Promoting academic excellence by developing existing aca- 
demic skills for all college students. 

• Promoting educational efficiency by retaining greater num- 
ber of potentially successful students who might otherwise 
be lost 

Developmental education does seem to meet the requirements 
for a professional specialty within postsecondary education. Those 
who perform this specialty include not only practitioners but also 
those who conduct research in the field or who tram current or 
aspiring professionals 

Developmental education might then be defined as a professional 
specfaity concerned with promoting educational opportunity, 
academe skill development, and educational efficiency in post- 
secondary education A developmental educator would then be 
anyone who has a primary professional commitment to this 
specialty as evidenced by his or her particioation in research, 
training, or delivery of services in the field And developmental 
programs wou'd include any organizational entity on a college 
campus designed to accomplish the mission of the field 



Measuring Effectiveness in Developmental Education 

If one accept trie definition of developmental education as stated 
here, a itiethodo'ogy for measuring effectiveness in the field 
becomes apparent That methodology should be based on the 
mission of the professional specialty Known as developmental 
education The Question to be asked in measuring the effectiveness 
of developmental education js, Does the field accomplish us 
mission'*" Specifically, cio the fields programs and services 1) 
promote educational opportunity by training underprepared 
students m the skills necessary for success, 2) promote academic 
excellence by developing existing academic skills for all college 
students, and 3j promote educational efficiency by retaining 
greater numbers of potentially successful students who might 
otherwise be lost 7 
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In answering the first question, it is necessary to establish a link 
between skills training and equal educational opportunity In 
Beyond the Open Door. K PatnCia Cross 0974) builds a strong 
case for this linkage In her view, students who have been un- 
successful in past educational experiences must have access to 
special assistance it they are to have any chance of taking advan- 
tage of open admissions policies in order to attain a college educa- 
tion Without this special assistance- she argues that the open 
door soon becomes a revolving door" and that the concept of 
equal educational opportunity becomesa mockery In essence, we 
cannot have equality of opportunity in postsecondary education 
without developmental programs to tra n underprepared students 
rn basic skills To determine whether or not developmental 
programs are working to promote educational opportunity, there- 
fore, we must ask whether or not they are successful m training 
underprepared students ;n basic academic skill areas 

With regard to the promotion of academic excellence, it would 
stand to reason that students cannot meet high academic standards 
until they have mastered basic academic skills Before one can 
expect excellence of a student, that student must first be compe- 
tent Developmental education serves to promote academic 
standards by building the skills necessary to meet academic 
standards H developmental programs are Successful m promoting 
academic excellence, therefore, they should be able to demonstrate 
thst they have improved student competence They should also 
provide evider.ee that their services not only enhance basic skills 
but that the students who participate m these services are able to 
attain fairly high grades in later course work 

Insofar as educational efficiency is concerned, it would certainly 
be more efficient ■- not to mention cost-effective -- to try to retam 
potentially successful students than to constantly have to replace 
Currently enrolled students through new admissions It is olten 
argued, however that efficiency can be accomplished through the 
usr- of selective admissions standards There are two flaws in this 
argument In the first place, selective admissions has not improved 
retention efficiency in the past Jencks and Riesman point out that 
the percentage of students retained through graduation at four year 
institutions has remained at a relatively constant 33% for the last 
several decades (1968) No new evidence has been presented to 
show that this percentage changes regardless of the admissions 
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criteria used to seleci students There is little historical or factual 
information to support the contention that selective admissions 
procedures lead to improved retention 

The second flaw m the argument for selective admissions as an 
efficiency measure is that the college age population has declined 
substantially in the last decade and will continue to do so through 
the remamder of the 1980's (Carnegie Council o,i Policy Studies m 
Higher Education, 1980) During a period when there are fewer 
student? available - at any level of academic skill it seems 
unlikely that many colfeges or universities will be able to Mil their 
classrooms with larger numbers of better-qualified students 

At present, therefore, the best method of improving efficiency in 
retention -s to develop and maintain programs that will lead to 
greater retention for all students As this is one of the mission 
components of developmental programs, their effectiveness may 
be measured by the degree to which their students are retained as 
compared io normal retention rates for students who do not 
participate in these programs 

ft would appear that the question of whether or not developmen- 
tal education is working can be answered by asking three sub- 
questions 

1 Do developmental programs actually imp. ove the bas<c 
academic skills of those students who participate in them 7 

2 Do students who participate in developmental programs 
actually obtajn higher grades following participation 7 

3 Do students who participate in developmental programs 
actually have higher rates ol retention than those who do not 7 

Fortunately, an increasing amount of program evaluation and 
research has taken place in the last decade in an effort to answer 
these questions While data gathering techniques differ from 
campus to campus and study to study and while different aspects of 
these questions 3re investigated in a variety of different ways, there 
is more information available to answer these questions today than 
at any point in the history of developmental education It is the 
purpose of this report to analyse the available data m order to 
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provide at least a preliminary answer to the general question, "1$ 
developmental education working?" 
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CHAPTER II 



Research Assumptions 



For the purpose of this study, it was assumed that developmental 
education activities might be fudged as effective if evidence 
suggested that these activities: 

1 Improved the basic academic skills of those who participated 
in them. 

2 Resulted in higher grades for those who participated in them 
when compared to those who did not participate, 

3 Resulted in higher ratesof retention for those who participated 
in them when compared to those who did not participate 

Admittedly, these assumptions are difficult to test empirically 
Many of the measures used to test these assumptions are indirect 
and suffer from a number of limitations. Nevertheless, it is assumed 
that while individual studies testing these assumptions do have 
limitations, the g£>ifcfai trends u* <*ii studies can provide useful 
information in answering the question of whether or not develop- 
mental education is working 



Methodology 

In order to obtain information relevant to the assumptions of this 
study, a survey of research and evaluation reports from the field of 
developmental education was undertaken. The survey was carried 
out utilizing the following sources" 

• The literature m the field was reviewed to identify articles, 
books, and monographs that included documentation of thf> 
effectiveness of developmental education activities 

• A DIALOG search was conducted to identify unpublished re- 
ports documenting the effectiveness uf vacuus developmental 
education activities 
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* A call for program reports documenting the effectiveness of 
developmental education activities was issued through the 
NARDSPE Newsletter, 

The reports gathered from these sources were then reviewed to 
determine their suitability for inclusion in this study In order to be 
included m the study, reports must ha\*e met the following criteria 

Suitability of setting, Reports must have been based on studies 
undertaken at institutions of postsecondary education in the United 
States or Canada 

Suitability of subjects. Reports must have been based on 
programs serving adults enrolled on a full-time or part-time basis 
These adults must have been classified in one way or another as 
"developmental students " 

Nature of data. Reports must have included quantifiable out- 
comes of developmental education activities using data that was as 
objective as possible 

Recency of data. RpporK must have been unrlertekpn withm thp 
last ten years and. preferably, after 1975 

Method of study. Reports must have been free of senous method- 
ological flawo such as comparison of differential levels of aptitude 
or inappropriate use of statistics 

Reliance of information. Reports must have investigated some 
area of developmental education activity relevant to the assump- 
tions under consideration m this study 

A total of 73 reports were reviewed in this manner Of these. 51 
were considered appropriate lor inclusion in the study These 
reports were then classified according tu the assumptio ,s which 
they addressed and the types of data which they employed A 
summaiy of the reports relating to each assumption and =he data 
requiting from these reports was then developed The trends from 
all reports relating to a givun issumption were then analyzed 
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* Characteristics oi Reports 



The vast majority of program reports reviewed in this study were 
undertaken for trie purpose of program evaluation Most of these 
reports we f e m-house" studies Only a handful were conducted by 
outside evaluators and consultants 

Measures typically employed in these reports were gain scores 
from pre-test to post test on standardized instruments, grade point 
averages of students at various points following participation in 
developmental education activities, and retention rates of students 
at various points following Participation in developmental educa- 
tion activities In reports assessing grade point averages and 
retention rates, experimental and control groups were often used 
for comparative purposes Expenmentaf and control groups were 
also used frequently m assessing gam scores 

The majority of therepoits considered *n this study were unpub- 
lished For the most part, the reports were part of a program 
evaluation plan and vv^re not intei ?ed for publication Many of the 
published documents were designed to report applications of new 
techniques and evaluative data was included primarily as a medns 
of validating the new techniques Some of the reports cited in this 
study have appeared m print elsewhere as supportive data for the 
validity of developmental education generally or the appropriate- 
ness of some specific tecftmque for working with developmental 
students 

Limitations 

Much of the data cited here was obtained initially through 
program evaluation activities In those cases where the evaluation 
was conducted primarily for the purpose of program refinement or 
improvement, it *s likely that negative data was included as welt as 
positive data In tho^e cases where reports were prepared to 
demonstrate program effectiveness or to establish accountability, it 
fs possible that somo negative data may have been glossedove r in 
order to improve a program s appearance It is probable that most 
"c house" program evaluation reports were designed to accom- 
plish both purposes In eithe r case, program evaluation reports 
were usually not designed as experimental research efforts While 
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they may have met many of the methodologica! requirements for 
experimental research, the potential subjectivity of these reports 
represents a possible limitation to the validly and reliability of the 
data 

The published reports cited here suffer from the limitation of all 
such reports Specifically, professional journals are more likely to 
report successful outcomes than unsuccessful outcomes. As a 
result, there is no way of knowing how many studies may have been 
undertaken which suggested negative outcomes for developmental 
education activities The fact that a variety of sources of 
unpublished reports were tapped in gathering data for this study 
controls this to degree but does not eliminate this limitation entirely. 

Finally the techniques used to assess the effectiveness of various 
developmental education activities are, themselves, subject to 
limitations of validity and reliability. The use of gam scores, for 
instance, is subject to limitations brought about by the so-called 
interactive effect of pretesting The use of grade point averages as a 
measure of the effect of a particular treatment does not take into 
account a number of intervening variables that may also have an 
impact on student grades Similarly, retention data is also subject to 
an even greater number of variables outside of hedtuienl that may 
affect the persistence of any given student 

Certarnly there are many limitations to thedata used in this study 
It is hoped however, that the general trends suggested by thedata 
will be useful as a starting point in assessing the general effective- 
ness of developmental education activities at posteecondary 
institutions across the country 
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CHAPTER III 



RESULTS 

Basic Skills Development 

One of the most common components of developmental educa- 
tion programs is a curriculum devoted to basic skjlls improvement 
in areas such as reading, writing, mathematics, and science. It is 
assumed by most developmental educators that participation m 
these courses will enhance students 1 basic skill levels and enable 
them to meet the requirements of regular college academic work. 
This, in turn, is assumed to be related to better grades, improved 
retention, and improved ability to meet academic standards on the 
part of underprepared students 

Since these assumptions are one of the cornerstones m the 
design and implementation of developmental programs, it is 
important to know if they are accurate assumptions The initial 
question to be answered, therefore, is whether or not students 
participating in basic skiii courses aciuaiiy do improve their skills. 
This question has been explored by a variety of reports using gam 
scores from pie-test to post-test as a measure of the effectiveness of 
basic sktll courses in improving student teaming skills 

One of the earlier studies assessing the impact 01 basic skills 
courses in developmental programs was reported in 1975 
(Donovan) In a study conducted by the Instjtute for Services to 
Education, thirteen colleges offering basic skjlls courses contrib- 
uted data on student gam scores in the areas of English, mathe- 
matics, and science The data indicated that students who parti- 
cipated >n basic skills courses through some sort of developmental 
program consistently showed substantial gain scores from pre-test 
to post-test on standardized testing instruments. Furthermore, 
those underprepared students who participated in basic skills 
courses demonstrated consistently higher scores on the standard- 
ized tests than those who did not participate in such courses 

Later studies of basic skills courses in developmental programs 




have yte* J ?d similar results Carter (1976)* reporting on basic skills 
courses at the Community CofJege of the Finger Lakes found that 
students enrolled in those courses showed consistent increases 
from pre-test to post-test on a combination of standaidized and 
locally-developed achievement measures Of those participating tn 
the program. 71% showed gams in reading scores. 68% showed 
gains in English scores, and 55% showed gams in mathematics 
scores 

Sutherland and Sutherland (1982) found that students enrolled in 
a combination of basic reading and writing courses demonstrated 
significant gams on standardized measures of reading* vocabulary, 
and writing They also showed substantial gains on writing samples 
graded by English instructors from outside the developmental 
program The gains demonstrated by underprepared students on 
these measures were also superior to those shown by a control 
group of better-prepared students enrolled in regular reading and 
writing courses 

These findings are consistent with results of studies of student 
gam scores in individual basic skills courses at other institutions 
across the country Reports from Bowling Green State University 
(Whtmbey. Boylan.and Burke. 1979). East field Community College 
(Swmoling, 1982>. me University of Georgia (Moore* 1977)* Grant 
MacEwan Community College f Altarre. 1979). Keystone Junior 
College (Bellucci, 1981). and Winston-Salem State University 
(Supplementary Education Program. 1982) all suggest that those 
students who participate in basic skills courses improve their skills 
as measured by a wide variety of standardized and locally- 
developed tests 

In reviewing studies of gam scores m basic skills courses, three 
trends seem to emerge 

1 Those who enroll m basic skill courses show measureable 
gams in basic skill development 

2 Those who enroll m basic skill courses tend to show greater 
gains in basic sktlls than Similar students who do not enroll 
m such courses 

3 Underprepared students who enroll m basic skill courses 




ERIC 



frequently score higher on standardized tests administered 
following the course than better piepared students who took 
the same test but did not enrol! in the baste skill courses 

This iatter finding was not reported consistently nor was it found 
m alf basic skill areas Jn some cases, underprepared students do 
perform better on standardized tests of basic skilb than their more 
well-prepared peers following participation in basic ski Jl courses In 
oir>er cases, whfle underprepared students show definite improve- 
ment in basic skills their scores on standardized tests are still lower 
than those of better prepared students who do not take basic skilJ 
courses 

Gain scores for underprepared students also seem to be greater 
in some basrC skill areas than m others In all the reports reviewed, 
for instance, gains in reading seemed to be greatest Gains in 
composition skills were next greatest followed by gams in mathe- 
matics skills A tendency was also noticed for underprepared 
students to score higher on locally-developed cntenon referenced 
tests keyed to course objectives than on standardized tests keyed to 
normative data 

The research clearfy suggests that underprepared students who 
parncipate in basrc skills development courses improve their 
academic skills as measured by a wide variety of instruments The 
extent of thrs improvement, however, varies from program to 
program and from subject to subject The improvement in basic 
skills following participation in skill development courses does 
seem to be consistent regardless of the instructional techniques 
employed or the measurements used to assess gain 

Another measure of the effectiveness of basic skill courses has 
also been proposed by Suen (1979) He h=is proposed a sophisti- 
cated statistical approach using Step-Wise Regression to separate 
the effects of various treatments designed to improve grade point 
averages for underprepared students Using this approach to 
assess the Special Services program at the University of Wisconsin - 
Oshkosh. Suen found That the basic skill courses in mathematics, 
English, and study skills appeared to have the greatest influence on 
improved GPA for students participating in the program While this 
sruay remans to be repncaled at other institutions, it does provide 
further evidence of the effectiveness of basic skill courses m 
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improving students* abihty to succeed in college , 

GPA improvement 

If developmental programs are designed to help underprepared 
students succeed in college, then they should be able to 
demonstrate that the students they serve actually attain appropriate 
grade pomt averages Even jf they can show that skill development 
takes place following basic skill courses* this development isirrele- 
vant unless it enables students to meet academic standards The 
question to be addressed, then, is "Do developmental students 
actually improve their grade point averages following participation 
in the developmental program and is this improvement greater tor 
those students who participate than those who do not?" 

A great deal of effort has been directed to answering this 
question Analyses of grade poirU averages has tended to be one of 
the primary evaluation measures for developmental programs As a 
result, a substantial amount of data exists to assess the impact of 
developmental education activities on grade point averages 

An early study of this jssue was conducted by Franco (1975) at 
California State University - Fullerton He found that students 
participating in a developmental program combining basic sKills 
instruction with tutoring, counseling, and learning assistance 
activities improved their cumulative grades from an average of 
1 73 upon entry to 2 32 following a year's participation in the 
program 

A study* of a basic skill curriculum combined w*th peer counseling 
at the University of Florida (Burton Brown, 1975) revealed that 80% 
of the students who entered the program with grades below 2 00 
were able to raise their grade point averages above 2 00 following 
participation in the program At Keystone Junior College in 
Pennsylvania, forty-six underprepared students whose predicted 
GPA was less than a 2 00 were provided with a combination of 
counseling and basic skills development courses following entry 
into the college Of these, twenty-eight (6l°/o) exceeded their 
predicted GPA after only one academic term of participation in the 
program (Farkas. 1982) In a similar study of the developmental 
program at Bowling Green Siate University, a group of 326 
underprepared students were enrolled in individualized basic skill 
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courses and provided with peer counseling and tutoring. Of this 
group. 225 (69%) raised thetr GPA by an average of 20% following a 
semester's partrcipation For those students who participated for an 
entire year, the average gain in GPA was approximately 30% 
{Boylan, 1979} These fmdings were supported by other studies 
conducted by Turner and others (1974)* Burgessand others (1976). 
and Haburton (1977) Jn addition, Thompson (1977) reviewed 
studies of underprepared students at eighteen different college 
campuses and concluded that participation in a basic skills 
development program was related to improvement in grade point 
average on practically every campus studied 

Several studies of grade point average improvement have also 
used control groups to aetermtne if such improvement was related 
to participation m developmental programs or if it was simply the 
result of maturation or some other factor Rouecheand Snow (1977) 
Cite data from Et Paso Community College COmpanng a random 
sample of entering freshmen with participants in a basic skills 
onented developmental program Both groups enrolled in basic 
English and mathematics courses during the first semester of their 
freshman year at the college Of the students selected at random> 
73% failed their English courses and 80% failed their mathematics 
courses For those participating in the developmental program> 
only 29% failed Enyirsh and 20% railed mathematics courses 

In a well-designed study by Martin and Blanc (1981. p 22) at the 
University of Missouri - Kansas City, the authors compared the 
grade point averages of 72 students who had participated rn the 
developmental program with a matcheo group of 131 students who 
had not The comparisons were made for a two year period with year 
end GPA being computed for both groups. The results indicated 
that those who participated in the program " showed a marked 
tendency to earn higher grades/* 

A similar study was conducted by Peck and others (1981 ) at Mid- 
America Nazarene College Using an experimental group of 44 
students who had participated in the developmental program and 
an experimental group of 16 students of similar backgrounds who 
had not participated in the program* the authors compared the 
grades of both groups over a one-year period Among the students 
who had participated *n the piogram.72 7% attatneograae averages 
of C or better (including 47 8% who earned grade averages of A or 
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B) For the students who did not participate in *he progran, only 
56 2°o earned grade averages of C or better 

Some of the most extensive research on grade point average 
improvement has been conducted by the State Education Depart- 
ment of New York m the evaluation oi the State s Higher Education 
Opportunity Program (HEOP) In the 1975 HEOP study a group of 
370 HEOP participants were compared with 274 students of similar 
economic and academic backgrounds who did not participate in the 
HEOP program During 1974, the mean GPA for HEOP students was 
2 33 while the mean GPA for sirrvlar students not participating in the 
program was 1 79 A sample of over-all GPA for graduates of HEOP 
students in that year was aEso matched to a sample of over-all GPA 
for non-HEOPstucents The HEOP students who graduated in 1974 
had an over-all mean GPA of 2 65 while those students who did n ot 
participate in the program graduated with a mean GPA of 2 39 i The 
University o f the State of New York, Office of Higher and Profes- 
sional Education, 1975) Similar results were found m later studies 
of HEOP students participating in developmental programs across 
the State of New York (The University of the State of New York, 
Bureau of Higher Education Opportunity Programs, 1980 and 
1981) 

The avaiiaoie aata suggests that tnose wno participate in oevel- 
opmental programs tend to improve their college grades From 
reviewing the data the following comments may be made 

1 Students who participate m developmental programs are 
hkefy to obtain higher grade point averages than admissions 
predictors would indicate 

2 Students with "ow grade point averages tend to improve their 
GPAb following participation in developmental programs 

3 Students who participate in developmental programs tend to 
obtain higher grades than similar students who du not par- 
hcipate in such programs 

Then; is strong evidence available to support the assumption that 
participation m developmental programs is related tu improved 
graae point averages for unaerprepared students The evidence 
also buppurts tru 1 assumption that underprepared students who 




participate in developmental programs obtain higher grades than 
similar students who do not 

Rates of Retention 

In recent years, an increasing amount of attention has been paid 
to the* Tssue of student retention In fact, developmental programs 
are frequently justified on the basjs of their presumed contribution 
to mcreased retention of students In a period where educational 
resources are limited and cost-effectiveness is a priority for post- 
secondary institutions, the retention issue is an important one If 
developmental education is to be judged as effective, develop- 
mental programs must be able to document their contribution to 
student retention Fortunately, retention data is one uf the most 
frequently u sed evaluation measures for developmental programs. 

In a survey of six Texas community colleges, Appel and others 
H977) found that students receiving individualized instruction and 
counseling through developmental programs were retained 
through graduation at a much higher rate than students who did not 
receive these services Furthermore, the degree of retention tended 
to increase as the amount of services available to students in- 
crpased In other words those campuses that had comprehensive 
developmental programs had greater retention rates than those 
which did not 

In a study of two groups of underpreparecl students at the 
University of Minnesota Technical College Starks and KuzOik 
M977> found that those who participated in a reading and study 
skills program were retained at much higher levels than those who 
did not Of the 125 students who enrolled in the reading and study 
skills program durrng their first semester. 105 (84%) were still m 
schoof at the end of their second semester while only 86 ( 69V o f the 
control group of students wno did not enrol! in the program 
remained in school by the end of their second semester 

LePage and Zache) (1978) surveyed developmental programs at 
103 colleges and universities m the midwest United States to 
determine the rates of retention among students enrolled m these 
programs While the yearMo-year rates of retention ranged from 
25% to 90 y f, the average retention rate reported was approximately 
66% with mos' schools reporting retention rates of 55% to 75% 




While no control groups were used in ths * tudy, the average rate of 
retention for all students among institutions responding to the 
survey was approximately 3 q % during the same period 

A statewide study of all institutions in the University of Georgia 
System indicated that the retention rate for students participating in 
developmental programs was several percentage points higher 
than the average retention for all institutions in the state (Nash, 
1977) Similar results were found at the University of Wisconsin - 
ParkSide in comparing the retention rates of those who had 
participated in the developmentai program with the institution- wide 
retention rate in addition, the number of students from the program 
placed on probation or dropped" status was significantly lower 
than the institution-wide average (Cashen and others, 1981). 

Using a slightly different control group. Helm and Chand (1983) 
compared the retention rates of students who had successfully 
completed developmental courses during the first semester of their 
freshman year with a group of students who had enrolled m these 
courses but failed to complete them successfully Using follow-up 
registration for the next three semesters, the authorsJound that 
those who had successfully completed the developmental program 
were retained at significantly higher rates than those who had not. 

These studies have also been supported by results from a variety 
of other colleges and universities Comparisons of underprepared 
students enrolled in develop mental programs with similar students 
not enrolled in such programs at Glendale Community College in 
California, Forest Park Community College in St Louis, Los 
Angeles City College. Muunt Hood Community Coilege in Oregon* 
and Pierce Junior ColL^t m Philadelphia, all suggested that those 
participating in developments prugrams were retained at higher 
rates than those who did not (Starks. 1982) 

This review of literature, research, and program reports did not 
find a Single instance where participation in a developmental 
program was associated with lower rates of retention All the 
evidence reviewed suggests the participation in developmental 
programs is associated with higher rates of retention In reviewing 
the data un retention in developmental programs, it appears that 

1 Students wha participate in developmental programs are 
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retained to a greater degree than might be anticipated given 
their prior academic records and college entrance scores 

2 Students who participate in developmental programs are 
more likely lo be related than Similar students who do not 
participate in such programs 

3 Students who participate in developmental programs are 
frequently retamed at hjgher rates than better-prepared 
students who do not participate in such programs 

This latter findmg js particularly interesting In most cases, the 
reported retentfon rates for students m developmental programs 
are higher than the over-all institutional retention rates This is in 
spite of the fact that mstitution-Wfde retention figures are based on 
ia<ge numbers of students who. presumeably. are better prepared 
for college than 'hose m the developmental programs Among all 
the measures used to support the idea that developmental educa- 
tion makes a positive contribution to postsecondary education* the 
record of developmental programs in promoting increased reten- 
tion is perhaps, the strongest 

Other Measures of the Impact of Developmental Education 

The effects of developmental education programs in enhancing 
basic skills, improving grade point averages, and promoting re- 
tention were selected as evaluation criteria lor this study because 
these factors tend to be directly related to the mission of the held. 
Developmental programs may also be viewed as "successful 1 ' by 
looking at olher factors One such faclor might be the degree to 
which students who have completed developmental courses are 
successful in regular courses In a follow-up study of students who 
completed basic skill courses m English* mathematics, and speech^ 
communication through the developmental program at Bowling 
Green State Umversjly, Boyian (1977) found that the grades of 
these students m the next level of courses in these subject areas 
were higher than those of Similar students who did not participate in 
the developmental program The differences in grades for Ihepost- 
developmenla! education students as opposed to the non-develop- 
mental stud* nts was positive and statistically Significant in English 
and speech comniunication courses While the comparison was 
favorable to ine post-developmental students in mathematics 
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courses, the differences were not significant. Similar results were 
found by Bo^ar (1983) at the Community College <~,f Philadelphia 



Similar findings were reported by Shell (198?) m a study 
conducted at Piedmont Technical College in South Carolina In this 
study, students who had completed the developmental English and 
mathematics courses were compared to a control group of similar 
students who had not enrolled in these courses Grades obtained in 
the regular curriculum English and mathematics courses were then 
compared for the two groups In the English course T 77% of the 
former developmental students received grades of "C" or better 
white onfy 52% of the non-developmental students received grades 
of "C ,T or belter In the mathematics course. however the non- 
developmental students outperformed the developmental students. 
67% of the non-developmental students received grades of C ' or 
better while only 5l°b of the developmental students received 
grades of "C" or better 

While the evide^c 0 is. as yet< inconclusive, participation in a 
developmental program's basic skill course tends to increase the 
likelihood o1 success in later courses This would also suggest that 
)asiC skills enhancement provided through developmental 
programs enables regular college and university fa ,ulty to hold 
post-developmental students accountable for normal standards of 
acad3mic performance 

Another factor m assessing developmental programs is that of 
student satisfaction with program activities While student satis- 
faction >$ not necessarily related to success in college, it does seem 
to be a reasonable indicator of how well developmental programs 
are working In fact, many early studies of developmental programs 
were based primarily on student* expressed level of satisfaction 
with program services Donovan (1975) reported that students 
expressed high satisfaction with developmental programs par- 
ticpatmg m the TIPSE-funded 'National Project II Alternatives to 
the Revolving Door " Practically all the programs reviewed as part of 
this project reported that participating students enjoyed their 
experiences and considered the programs to have been quite 
helpful Similar results were reported by Broadbent (1977) at 
Leeward Community College in Hawaiu Kinnebrew (1975) at 
Sacramento City College in California, and Rachavong (1979) at 
West Virginia Stale College. 
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It appears that underprepared students tend to rate 
developmental programs highly. Most students express satisfac- 
tion with the quality of services, the helpfullness of staff, and the 
degree to which the services have helped them be successful. Little 
evidence exists, however, to determine whether this expressed 
satisfaction is related to successful academic performance on the 
part of students. 
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CHAPTER IV 



SUMMARY AND COMMENTS 

Earlier efforts to assess the effectiveness of develcpmenlal 
education activities have met with mixed results. In using GPA as a 
criterion for program effectiveness. Santeusanjo [1974) found as 
many studies showing no relationship between GPA gains and 
participation in developmental programs as he did showing a 
positive relationship Tilman (1973) found thai studentscompleting 
reading and study skills programs demonstrated only slight 
increases in GPA while studies by Raygor (1974) and Summers 
(1970) revealed mixed result; In her review of the research on 
developmental programs prior to 1975. Cross (1976, p 38) dis- 
covered " positive findings, no-difference findings, and ye >' on 
some tesls and T no + on others ,T 

More recent research reports, however, have tended to show 
more consistently positive results Furthermore, the reports and 
research studies of the latter 1970 s and early 1980 s have, for the 
most part, been designed more carefully than previous studies. The 
need for improved evaluation of developmental programs became 
auite apparent during the early 1970"s. As Roueche pointed out in 
1968 (p 47), "There is a paucity of research on the efficacy of 
remedial programs Indeed, with few exceptions, community 
colleges neither descnbe nor evaluate their endeavors m this 
critical area T " Comments such as this by Roueche and other leaders 
fn the fielC. coupled with increased demands for accountability T 
helped to stimulate improved research efforts More and more 
programs undertook evaluation acti^ties and did so with greater 
sophistication than in the past 

Evaluations of developmental programs began to use more 
control groups for comparative purposes and the statistical treat- 
ment of data became more sophisticated in addition, more 
sophisticated evaluation criteria were applied to assessing 
developmental programs Ratings of student satisfaction were 
employed less often and assessment of gam scores and retention 
data were employed more often The availability of low-cost micro- 
processors also improved the quantity and quality of data to assess 
developmental education activities. 
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At the same time, it is quite possible that the quality of develop- 
mental education activities improved during the latter 1970 1 S and 
early 1980 s Developmental education is a relatively new field and it 
no doubt took several years of trial and error before practitioners in 
the field were able to determine which techniques were most 
effective While old techmques were being refined, new techniques 
were aho being implemented New approaches to diagnosis and 
placement, individualized instruction, and assessment of learning 
styles were developed and disseminated throughout the field in the 
la*e 1970 s Many of these approaches proved to be superior to 
those previously used in developmental education. 

As a result of these factors, it is not surprising to discover in- 
creasingly consistent positive findings with regard to the effective- 
ness of develop mental education activities While many btudies are 
btill open to methodological questioning and while the limitations of 
such data as grade point averages, gain scores, and retention rates 
are well known, the quality of evaluation design, the quality of data, 
and perhaps, the quality of practice in the field seem to have 
improved in recent years Consequently, the question Is develop- 
mental education working^ can be answered affirmatively with a 
greater variety of higher quality information 



General T ends 

The general positive trends found in this study include the 
following 

1, Underprepared students who participate in basic skills 
courses tend to show measurable gains in skill development 
as assessed by a variety of standardized and locally-developed 
instruments. 

Such gains were found in all the studies reviewed and in all basic 
skill areas There were, however, vast differences in the amount of 
gam reported In some studies, gain scores from pre-test to post- 
test were insignificant for most students In others, gains of several 
hundred percent were not uncommon Furthermore, it appears that 
basic skills development activities are more likely to be successful 
in some areas than in o!nRr& Readina and studv skills courses 
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appear to have the greatest measured effect on student gam Gams 
in composition skills also tend to be fairly substantial in most of the 
studies reviewed Gains in mathematics and science skills, how- 
ever, tend to be slight in most cases 

2. Underprepared students who participate in basic skills 
courses tend to show greater measurable gains in skill devel* 
opment than simitar students who do not participate in such 
courses. 

This finding is. perhaps, an obvious one Students who take a 
course m reading or study skills or composition or mathematics 
ought to know more about ih$se subjects than students who do not 
take such courses As ir» the case of gain scores, there appears to be 
some difference in the relative performance of experimental and 
control groups according to subject matter. Those who participate 
in basic skills courses in composition tend to be consistently and 
i ather substantially superior in measured skill development to those 
who do not participate but have simitar academic backgrounds 
This also appears to be true for reading and study skills courses In 
mathematics and science, however, the differences are less 
apparent 

3. Basic skills development courses tend to reduce the differ* 
ences between underprepared students and better prepared 
students as measured by standardized tests. 

In many of the reports reviewed, those who participated in basic 
skills courses actually scored higher on standardized tests than 
better prepared students who did not take the courses About a third 
of the reports showed this outcome In all of the remaining reports 
where pre-test and post-test data was available for both the experi- 
mental and the control group, the gap between the measured skills 
of the underprepared students and those of their better prepared 
peers was at least, narrowed to a significant degree 

One problem in using gain scores to measure the effectiveness of 
developmental education activities is that such scores are not 
necessarily correlated with actual academic performance As Cross 
; 1976, p 32) points out. while the developmental courses may have 
improved test scores. " such test taking skills may not h aV e 
Transferred to other coursework 
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If developmental courses are to be effective in improving v 
students" skills and in helping underprepared students meet " 
appropnate acaderruc standards, then the gams shown on tests of 
basic skills must be reflected in later academic performance The 
research on improvement in grade point averages seems to suggest 
that bkill gains are correlated with improved academic perform- 
ance The findmgs noted in the regard a^e as follows 

4. Students who participate in developmental programs tend to 
perform better academically than their admissions creden- 
tials would suggest. 

Several of the studies reviewed indicated that, where admissions 
data *s used to predict entering student performance, those who 
participate m developmental programs usually exceed their 
predicted performance Although the data on this phenomenon is 
limited, the information available is consistent jn tbJS regard Of 
course, predictions based on admissions dat t4 assume that no'hmg 
changes between admission and the end of the students first 
academic term Obviously, for those students who outperform their 
predictions, something has changed And. although the potential 
factors influencing that change are myriad, one that seems to have 
some effect is participation in a developmental program While itis 
impossible to isolate the specific effect o\ basic skills courses on 
performance it would appear that, for underprepared students, the 
gams m skill development may be related toacademic performance 
that »s better than might be expected given the background of such 
students 

5. Students with low grade point averages tend to improve their 
GPAs following participation in the developmental program. 

This finding was also shown to be fairly consistent As might be 
expected, there was a substantial range for GPA improvement 
Some studies showed a mean gam of only a few percentage points 
while others showed a mean gain equivalent to a full letter grade All 
studies reviewed, however, suggested that students who partici- 
pated in developmental programs did improve their grade point 
averages to some degree Of course, *t cannot be claimed that this 
participation was Ibe only reason for GPA improvement There 
does, howt?v*>r. appear to be a clear connection between partici- 
pation in developmental educatton activates and an increase in 
grade point average for most unjEterprepared students 
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6. Underprepared students who participate in developmental 
programs tend to obtain higher grades than similar students 
who do not participate. 

The use of control groups to assess the relative impact of de- 
velopmental education on GPA helps to strengthen the case for 
developmental services as a major contributor to improved GPA 
In all cases studied, those who participated in developmental 
programs obtained higher grade point averages than control 
groups of similar students who did not Again, there was a wide 
range of differences in the findings but most of the results were 
statistically significant and none of the studies indicated that the 
control groups performed better than the developmental students 

Assuming that participation in basic skill development courses is 
related to improved basjc skills and that these improved basic skills 
are related to improved grade point averages, it would be reason- 
able to expect that those who participate in developmental 
programs are retained in postsecondary institutions to a greater 
extent than those who do not The studies reviewed here bear out 
this expectation In general, it was found that 

7. Underprepared students who participate in developmental 
programs are retained to a greater extent than would be 
expected based on admissions credentials, 

Cross (1976) has suggested that, without some form of develop- 
mental education, less than 20% of the underprepared students who 
enter colleges and universjtjes can be expectd to graduate 
Research by Ludwig and Gold (1969) and Snyder and Blocker 
(1970) suggests that the graduation rates for underprepared 
community college students who do not obtain assistance in 
developing their skills is about 30% Effective developmental 
education programs should tie able to demonstrate that their 
students are retained in greater percentages than these And. the 
studies reviewed here are consistent in this regard In the LaPage 
and Zachel (1978) study, for instance, not a single program of those 
surveyed reported retention rates of less than 50°^ In a study of 
community colleges in California. MacMillan and Kester (1973) 
found that developmental education services consistently reduced 
projected attrition rates for underprepared students by at least hali 
VVhrie tne exact impact on developmental services on retention of 
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underprepared students is difficult to assess, it is clear tnat such 
services do have a strong positive impact 

8, Underprepared students who participate in developmental 
programs are more likely to be retained than those who do not. 

The use of control groups to assess the impact of developmental 
education on retention has vastly strengthened the case for the 
effectiveness of developmental education In all of the studies using 
control groups, those underprepared students who participated in 
developmental programs were consistently retained at higher rates 
than similar students who did not participate This suggests that 
such participation is a major variable in improving student reten- 
tion 

9, Underprepared students who participate in developmental 
programs are frequently retained at higher rates than better 
prepared students with superior admissions credentials. 

This phenomenon was one of the more surprising findings of this 
study While the evidence to support this contention is mixed, the 
majority of reports using better prepared students for comparative 
purposes indicated that those who participate in developmental 
programs were more likely to be retained in spite of their compara- 
tive academic deficiencies In fact, of all the measures studied, this 
is one that most consistently favors underprepared students 
participating in developmental programs compared to control 
groups of better prepared students As Roueche and Kirk (1974) 
and Astm (1975 and 1977) have pointed out. individual contact with 
faculty does seem to have a positive impact on retention for all 
groups of students Since participants in developmental programs 
recede a great deal of individual attention in a supportive environ- 
ment, it is possible that this variable alone accounts for a large part 
of the phenomenon In any event, if developmental programs are 
judged on their capacity for improving student retention, the 
evidence seems to suggest that this capacity is substantial It aiso 
suggests that developmental education programs do a better job of 
retaining the students they serve than the programs of the campus 
at large do in retaining alt students 



Building the Case for Developmental Education 

In designing this study data to support the effectiveness of 
developmental education activities was collected at three levels — 
primary, secondary and tertiary In evaluating a program, jt is 
necessary to ask first whether or not the program actually did what it 
was supposed to do At the primary tevel of evaluation, then, the 
question to be asked is 'Do developmental programs actually 
contribute to an increase in students basic academic skills^ The 
answer to this appears to be yes T ' Students who participate in basic 
skfll development programs Consistently show improvement in their 
academic skills 

At the secondary level of education it is necessary to determine if 
program outcomes have any impact at the intermediate level of if 
there are follow-up beneMs to participation In developmental 
education the secondary or intermediate Jevel benefits would relate 
to student performance following participation in a program The 
question here would be Do those students who have completed a 
developmental program obtain better grades than la) might be 
expected and (b) other students from similar backgrounds who 
have not completed a program^ j ne answer here again appears to 
be yes ' There is evidence to support the notion that developmen- 
tal education participation is related to improved GPA for under- 
prepared students and that this improvement is greatc-r than that of 
similar students who do not participate in developmental programs 

Finally it is necessary to ask if there are any long-term or tertiary 
benefits associated with a given program In the case of develop- 
mental education long-term benefits could be assessed in terms of 
retention rates The question to be asked at this level oi evaluation is 
Are students who participate in developmental programs retained 
longer than fa) might be expected and, (b) other students from 
similar backgrounds who do not participate 9 Here again the 
answer to this question appears to be yes 1 The evidence clearly 
suggests that those who participate \n developmental programs are 
not only retained to a greater degree than might be expected but 
that they are also retained to a greater degree than similarly 
prepared poers who do not participate in such programs 

While none of the variables assessed here would be sufficient to 
buiru a suiiU CHbfc for the effectiveness of developmental education 
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by themselves, when they are taken together, a direct chain of 
relationships emerges Activities designed to improve basic skills 
tend to accomplish this objective Those students who have thus 
improved their basic sKjIIs are then found to obtain better grades 
And, this improved academic performance js assumed to be related 
to greater retention for those students who participate in develop- 
mental programs This chain of relationships suggests that 
developmental education programs are elective in accomplishing 
their mission of 

• Promoting educational opportunity by training underprepared 
students in the skills necessary for success 

• Promoting academic excellence by developing existing 
academic skills for all college students 

• Promoting educational efficiency by retaining greater numbers 
of potentially successful students whu might otherwise be lost 

Miscellaneous Comments 

In the course of this study, several things became apparent from 
reviewing the research that were not directly related to the hypo- 
theses under consideration The data reviewed showed certain 
trends thai may be of interest to the practitioner These are sum- 
marized below 

1. Those programs which showed the greatest gain scores* 
GPA improvement, and retention also tended to be compre- 
hensive in scope, mission, and services, 

A comprehensive developmental program is one that offers a 
wide variety of services - not just a few basic skills courses Such 
programs typically include counseling components, tutorial 
components, and learning assistance components m addition to 
basic skills courses Some uf the reports reviewed suggested that 
the greater the variety of services provided, the more likely it was for 
participating students to show gains in test scores. GPA* and 
retention (Suen* 1979 and Boylan, 1979) Reports from programs 
offering a full battery of services also tended to show greater 
positive gains than programs offering only reading and study skills 
classes 
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During the last decade, a tendency has existed for developmental 
programs to expand the number and types of services offered, If 
there is, indeed^ a tendency for more comprehensive programs to 
'generate greater gains, then this tendency may account for the 
more positive reports of recent studies on the effectiveness of 
developmental education The research may also suggest that 
developmental programs would be well-advised to provide the 
broadest range of services possible given staffing and budget 
constraints 

2. Gain scores* GPA> and retention did not appear to be inllu- 
enced by the number of students served by a given program. 

Tnere appeared to be no major differences in reported student 
gains lor larger or smaller developmental programs Programs 
serving less than fifty students had ranges of gain similar to those 
serving several hundred students White data on staff to student 
ratios was not available, this finding suggests that serving greater 
numbers of students does not necessarily reduce the effectiveness 
of a developmental program Without more evidence on the rela- 
tionship of staff to student ratios and student gams, it is not possible 
to say this with certainty it does, however provide an interesting 
question for further research 

3. There appears to be Mttfe difference in reported results of 
developmental education activities lor programs on com- 
munity college campuses or programs on university cam- 
puses> 

Some professionals m the field have speculated that> since 
community colleges have been working with developmental 
students lar longer than senior institutions, community college 
developmental programs may be more effective than their counter- 
parts rn universities Others have suggested that the greater 
resources available on a university campus enable developmental 
programs at such institutions to do a more effective job Neither 
argument appears to be accurate In general, community college 
developmental programs and university developmental programs 
reported the same range of results The one exception to this is in 
the area of retentron University programs typically reported greater 
rates of retention than community college programs This may have 
mo'e to do with the residential nature of most of the universities 
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reporting m this study As Astm has pointed out (1975). residential 
students are more likely to be retained for longer periods of time 
than non-residential students Since the vast majority of community 
colleges lack residential facilities, they may be at a disadvantage on 
this dimension of retention Furthermore, community college 
students are more likely to face difficulty with work schedules, 
family problems, and f'nances than university students These 
factors might be expecteo io nave an adverse effect on retention 
beyond the control of community college developmental programs 

4, The amount of time spent by students in various developmen- 
tal services appears to be related to the level of student 
success. 

This is a fairly obvious finding It is reasonable to expect that 
stuaents who spend more time in tutoring, counseling, and indi- 
vidualized instruction would obtain greater gains on test scores. 
GPA, and retention Those studies that have recorded the amount of 
time spent by students on these activities (Supplementary 
Education Program. Winston-Salem State University, 1982. and 
Boylan. 1979) Suggest that time on task" is an important factor in 
student success The major practical implication of this finding is 
that developmental programs Should continue and expand their 
efforts to encourage student participation in program activities 

5, Certain testing instruments appear to be used more frequently 
than others in assessing the gains of students participating 
in developmental programs, 

The instrument used most frequently to assess developmental 
students seem;> to be the Nelson Denny Reading Test This test was 
used frequently by both community college and university 
programs The Comprehensive Guidance and Placement test was 
used frequently in community colleges and seldom m four year 
institutions The McGraw Hill Baste Skills Battery and the 
Comprehensive Test of Baste Skills, both oubhshed by McGraw 
Hill, were used most frequently in Jour year institutions The Wide 
Range Achievement Test was used frequently by both community 
colleges and four year institutions as was the Survey of Study 
Habits and Attitudes Other tests employed with some frequency 
were the Sequential Test of Educational Progress, the Stanford 
Achievement Test — Advanced Basic Battery, and the Descriptive 
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Test of Language Skttls. A number of campuses reported using 
cntenon-referenced instruments designed on the basis of local 
course objectives This was particularly true for the measurement of 
mathemalrcs skill development 

5. Programs that required students to participate at the outset 
of their college experience tended to report greater gains 
than programs requiring participation only after students 
had obtained low grades. 

The question of whether participation in a developmental 
program should be mandatory or voluntary for underprepared 
students has often been raised by practitioners m the fjeld The 
evidence suggests that those programs which require participation 
during the first semester or the first year for students who have poor 
admissions credentials have slightly better reported results in (he 
area of GPA and retention than those programs which do not 
require participation This suggests that early intervention may be a 
key factor in the success of developmental programs The evidence 
is not sufficient to state this with certainty It does* however, appear 
to be an issue worthy of further research 

6. Developmental programs offering credit for participation in 
basic skills courses tend to show greater gains from pre-test 
to post-test in those courses than programs which do not 
offer credit. 

White the evidence on this point is still insufficient to make any 
definitive comment, there does appear to be a tendency for those 
basic skills courses offering credit to produce greater gams than 
those which do not This is not particularly surprising since, as 
Grant and Hoeber have noted (1978. p 23) "Requiring a student to 
take basic skills courses but refusing to grant credit certainly 
causes motivational problems for Ihe student " Those courses 
which grant credit appear to have more motivational value to 
students than those which do not The motivational aspect of credit 
for basic skills courses seems to have an impact on performance in 
those courses This, too. is an area where further research might be 
profitable 

7. Research on developmental education appears to be conduc- 
ted as often In 2-year institutions as in 4-year institutions. 




Although community college programs were frequently Criticized 
fur their failure to assess developmental education activities in the 
late 1960 sand early 1970 s, they appear to have been more active in 
the area of program assessment in the late 1970s and early 1980 s 
At least they have been as active as four year colleges and univer- 
sities have been during this period Of the reports reviewed in this 
study, twenty-three were based on community ot technical college 
populations and twenty were based on populations of four year 
institutions There appears to be as much evaluation and research 
on the topic of developmental education in community colleges as 
there is in four year institutions This is in spite of the fact that four 
year institutions are presumed to be more ' research oriented" than 
community and technic^ colleges Apparently, insofar as develc ^ 
mental education activities are concerned, this presumption *s not. 
necessarily, an accurate One 

In reviewing recent research and evaluation efforts in develop- 
n° "al education, it was gratifying to note that the quality and 
quantity of these efforts seems to have increased since 1975 As 
early research studies showed ambiguous results based on in- 
adequate or inappropriate data, leaders in the field began to call for 
better and more frequent evaluation efforts in developmental 
education This call was matched by demands from legislators and 
educational administrators for developmental programs to 
document the outcomes Of their activities 

Apparently, fhese calls were heeded by practitioners m the field 
More research is now available to support thy effectiveness of 
developments education activities and much of the research is 
better designed than m the past As K Patricia Cross has pointed 
out (1976 p 36) By theearJy 1970'sthose responsible for remedial 
piograms were able to get down to the hard work of seeking new 
and better alternatives both the design and the evaluation of 
remedial programs have improved substantially in the 1970s" 
AM of ub in the field of developmental education are indebted to 
thuse responsible for this increased and improved research and 
evaluation activity It has helped to build a strong case for the 
effectiveness developmental education m accomplishing some 
of the must critical missions in contemporary postsecondary 
education 

4u 
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CHAPTER V 



FUTURE RESEARCH AND EVALUATION ISSUES 

Practically every research study undertaken concludes with a call 
for more research This siudy is no exception In reviewing previous 
research efforls. shortcomings of existing research or gaps in the 
available knowledge become apparent. As the field of develop- 
mental education grows and undergoes various transition, it will 
become increasingly important to overcome these shortcomings 
and fill the gaps in our knowledge 

It will be the responsibility of practitioners in the field, researchers 
on college and university campuses and graduate sludenls 
throughout the country to carry on the research efforts of the past 
and to advance the knowledge in the field for future practitioners 
For those who are interested in accepting tins challenge, the 
following suggestion ire offered for further research efforts 

Component Analysis 

The research to date suggests that those programs with the most 
comprehensive battery of services are more likely to produce gains 
in test scores, GPA, and retention than thoc* 1 with more limited 
services It is reasonable to assume that some .-pveiopmental 
services account for a larger part of this gam than others. As 
resources for developmental education stabilize, it wilt be bene- 
ficial to understand which program components are the most 
important contributors to student success By emphasizing those 
components which have the greatest impact and de-ernphasi2mg 
those components which have the least impact, developmental 
programs can continue to serve students we^l and do so in a more 
cost*cffectfve manner 

Suen (1979) has proposed a model that has great potential for 
accomplishing this component analysis Researchers are en- 
couraged to implement this model in renewing olher develop- 
mental programs in an effort to add to Our know/edge of why and 
how developmental education works 
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Criterion-Referenced versus Norm-Referenced Measurement 



Postsecondary educators have long been enamored with 
standardized, norm-referenced testsof student achievement Such 
measures are designed to describe a students performance jn 
relationship to all other students who to3k that particular test 
Criterion-referenced measures, on the other hand* " assess 
student achievement m terms of a criterion standard thus (pro- 
viding) information as to the degree of competence attained by a 
particular student which is independent of reference to the 
performance of others" (GJaser T 1971 T p 8) In other words, 
criterion-referenced measures are keyed directly to performance 
according to specie learning objectiv v s In cases where these 
objectives are matched to the actual skills required for success in a 
g*ven curriculum, it is quite possible that criterion-referenced 
testing would be a far better piedictor of later student performance 
than norm-referenced testing 

This possibility provides a valuable area for future inquiry If 
criterion-referenced tests serve as better indicators of actual 
student performance tnen they will add Substantially to our ability 
to assess developmental students Furthermore, since such tests 
are keyed to learning objectives, they will also provide an excellent 
source of diagnostic information The increased use of criterion- 
referenced tests may. therefore, not only improve our assessment 
and diagnostic capacity. Since they are. by definition developed 
locally but they may also reduce the costs of assessment and 
diagnosis by reducing the need to purchase commercially 
developed instruments 

This is not to say that standardized, norm-referenced tests WfJI not 
be necessary They will stil) serve a valuable function in the assess- 
ment and placement of students Criterion-referenced tests do. 
however, have the capacity to improve diagnosis while ^educing 
co^ts It remains lor future researchers to determine the potential 
merit of criterion referenced testing in developmental education - 
particularly insofar as their predictive validity when compared to 
norm- re fere need measures are concerned 

Follow-up Performance of Post-Developmental Students 

Whue a great deal of research effort has been directed to 
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assessing the immediate gams of students who participate in 
developmental programs and long term retention of such students, 
little is known about other possible effects of developmental 
education Some studies have investigated the performance of 
developmental students m regular English or mathematicscourses 
following participation in basic skills courses in these subjects 
While the results tend to favor post-developmental students as 
opposed to those who have not participated jn a developmental 
program, the evidence is not entirely clear cut Additional research 
information will be necessary before broad generalizations can be 
made regarding this issue 

Other long term effects of developmental education are also 
worthy of further study How does participation in a developmen- 
tal program affect s a crion of majors 7 How well do post-develop- 
mentai sfuoents penunn *n careers following graduation when 
crmpared to non-developmental students 7 Do developmental 
students display improved academic behavior sue has regular class 
attendance punctuality m returning assignments, consistency m 
doing outside readings, or more realistic selection of courses 9 To 
what degree are post-developmental students active in campus 
activities or student affairs following their participation in develop- 
mental programs 7 How do they compare in this regard with non- 
developmenta) students 7 The answers to these and other questions 
will serve to improve our understanding of the developmental 
student and our capacity to meet that student s needs 

Cost-Effectiveness of Developmental Programs 

Developmental programs are often criticized because they utilize 
resources m serving high risk students that could be applied to 
other endeavors that would benefit all students They are also 
criticized because thev use college level resources to resolve 
problems tH at m the minds of many, should have been corrected in 
elementary or secondary schools 

There is some likelihood, however, that a carefully planned and 
well-managed developmental program is actually a very lowcost 
operation — particularly when compared to other campus units 
Models for assessing the cost-benefits of developmental programs 
have been proposed by Boylan (1978) and O Hear and Pherson 
(1982) Using his model as a consultant to the developmental 
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programs at Rowan Technical College in North Carolina and West 
Virginia State College. Boylan found that the money spent on 
developmental education at these institutions was sjbstantialfy 
offset by resulting cost -benefits in the areas of retention and fulf- 
timo equivalent subsidies as well as additional tuition payments and 
longer residential occupancy lor students who might otherwise 
have been lost 

The cost-effectiveness in developmental education is and will be 
an increasingly important issue H will be necessa-y for 
practitioners in the field to detei mine what it actually costs to run a 
developmental program, what the cost-per-student is of providing 
developmental services, and what benefits accrue to institutions as 
a result of developmental education activities Assessment of these 
factors is a fertile ground for future research and one that will be 
important to the long-term viabiltty of developmental education 

The Utility ot Developmental Education for All Students 

While the field of developmental education is relatively new. the 
methodology employed jn most programs has its roots in theories 
of learning that have been available lor decades Essentially, most 
developmental education programs simply employ sound 
educational practices that have been utilized for years by 
successful instructors Consequently, there js probably a great deal 
of truth in the often repeated statement that developmental 
education can be beneficial for all students, not just those who are 
underprepared Yet, practiCdl'y ail research on developmental 
education is based on underprepared students Control groupsand 
experimental groups in developmental education research are 
usually selected from among those who present the poorest 
admissions Credentials 

Mor: studies are needed usmg additional control groups of better 
prepared students who are participants and non-p*rtiGinnts in 
developmental programs More information is needed about the 
effects o* developmental education activities on those students who 
appear to have the prerequisite skills necessary for college success 

In the long run. the future of developmental education may well 
be decided by the fields success jn promoting academic and 
persona! development ior dll sUidents — not just the most poorly 
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prepared students Research to support the effectiveness of 
developmental services for better prepared students, therefore, can 
be vitally important 



Competencies Necessary to Developmental Educators 

Since developmental education is a relatively young specialty in 
postsecondary education, a consensus on the skills and compe- 
tencies necessary to the successful developmental educator is still 
emeigmg Several efforts have been made to identify these skills 
and competencies Among the more notable are those of Maxwell 
(1979). Roueche and Thompson (1980), and Dickens (1980) 
Follow-up efforts are necessary to provide a basis for the training of 
future developmental educators, the development of graduate and 
in-service training programs, and the assessment and certification 
of developmental programs 

Chnst and Coda-Messerle (1981, p 102) correctly note that ,H As 
college administrators look ahead to the challenges of a changing 
student population and an increasingly complex informational and 
technical world for which they must prepare their students, training 
programs become more and more the answer for managerial 
efficiency, cost effectiveness and learner satislaction " The nature 
and composition of such training programs can best be determined 
by additional research on the skills and competencies necessary to 
the successful practice of developmental education 

Student Learning Styles and Treatment 

One of the more recent trends in developmental education 
practice has been the assessment of student learning styles 
Educators have known for aecades that different students learn in 
different ways The work of Canfield (1976), McCartny (1980), and 
Myers f 1980) has contributed greatly to our ability to assess the 
differences in the ways students learn and our capacity to use the 
results of this assessment in a productive manner 

Nevertheless, the practice of learning styles assessment and the 
design of instructional responses to assessment results ts still in 
relative infancy We need to know 1 1 )re about the learning stylesof 
developmental students and the v<*ys in which developmental 
educators can respond to these learning styles We need to kno*v 
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more about the utility of various instruments for assessing the 
learning styles of developmental students Perhaps most of all. we 
need to Know which techniques for accommodating individual 
differences in learning p^duce the best results These are not easy 
questions to answer through research but the answers* when found 
will provid3 a basis for vastly improved learning among develop- 
mental as well as all other students in postsecondary education 
If a quantum leap" *n our capacity to promote learning js to take 
place* it may very well come from improved understanding of 
individual learning styles and their implications for instruction 

Reasoning Skills and the Developmental Student 

Another recent trend *n developmental education is the provision 
of courses or other instruction in reasoning and Critical thinking An 
increasing amount of literature on the importance of reasoning 
skills for developmental students i& beginning to appear and more 
programs are beginning to include reasoning skill development as a 
part of thetr curriculum in fact, interest in reasoning skills develop- 
ment has lead to the formation ol a "Special Interest Group" on 
reasoning skills by the National Association for Remedial' De- 
velopmental Studies in Postsecondary Education 

One ot the leaders m the reasoning skills movement among 
developmental educators. Curtis Mites, has proposed (1978. p 22) 
that instruction m any discipline relies on the quality of 

students abthty to reason and that "Students who are weaker than 
need be in the.r reasoning abilities are crippled when trying to learn 
or practice anything else " While neither Miles nor anyone else 
proposes that the teaching of reasoning skills will provide a 
panacea for the problems of the underprepared learner. Ihis 
approach does have considerable potential for improving students' 
learning skills Unfortunately, research on the effect of reasoning 
skills training for underprepared students is. as yet. limited 
Additional research in this area may well provide important 
information lor improving the practice of developmental education 
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CONCLUSION 



No one has ev^r claimed that the practice of developmental 
education would be easy The developmental educator works with 
some of the most difficult clients in postsecondary educatron And 
he does this work with limited resources, liltle support, and even 
less recognition 

In many cases, developmental educators are among the most 
poorly paid professronaJsat their institutions Yet they do a job that 
no one else wants to do and manage lo obtain results that few others 
care about And, in addition to everything else, they are frequently 
accused of being ineffective in accomplishing their basic mission of 
nelpmg underprepared students to be successful m college 

If nothing else, perhaps the research results reported rnthis study 
will help to alleviate the latter situation The available research and 
evaluation rnformation from programs across the United States 
suggests that developmental programs do help students to rmprove 
their bcsic skills, obtain higher grades, and persist in their academic 
careers This is not an insignificant accomplishment 

The practice of developmental education may be a humble 
profession in academe but those who practice it do it well They also 
do it wilh a commitment to excellence and a commitment to the 
egalitarian philosophy of the 'open door' 1 to educational oppor- 
tunity 

As John Gardner has so eloquently pointed out (1961, P 86) "An 
excellent plumber is infinitely more admirable than an incompetent 
philosopher The society which scorns excellence in plumbing 
because plumbing is a humble activity and tolerates shoddiness in 
phrlosophy because philosophy js an exalled activity will have 
neither good plumbing nor good philosophy Neither its pipes nor 
its theories will hold water " 

Developmental educators seem to exemplify this statement They 
work wilh the most humble of students but they encourage 
excellence in those students And in an academic arena where 
research grants and scholarship are exalted, Ihe practice of 
developmental education is a humble profession Yet the research 
suggests thai developmental educators do their jobs well m most 



cases and* given the material With which they have to work and the 
results they are able to achieve, their efforts certainly represent 
excellence irVjpbst secondary education Developmental educators 
may* indeed, be looked upon by their colleagues in more traditional 
disciplines as the plumbers ' of postsecondary education There is t 
however ample evidence to suggest that they are excellent 
plumbers One is tempted to ask those who consider themselves to 
be the philosophers" of postsecondary education if they can 
demonstrate through research and evaluation that they do their 
jobs as well as developmental educators do theirs 
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APPENDIX I 



Institutions from which Data was Reported in this Study 

American River College. Sacramento, CA 
Bowling Green State University, Bowling Green. OH 
California State University, Fullerton, CA 
Community College of the Finger Lakes, Canandaigua, ny 
Dallas Couniy Community College System. Dallas. TX 
Eastheid College, Mesquite, TX 
El Paso Community College, £1 Paso, TX 
Forest Park Community College, St Lours, MO 
University of Florida, Gainesville, FL 
University of Georgia, Athens, GA 
Glendale Community Cotiege, Gtendaie. CA 
Grant MacEwan Community College, Edmonton. Alberta CA 
Gulf Coast Community Coitege, Panama City, FL 
Harnsburg Area Community College, Harnsburg, PA 
Higher Education Opportunity Progiams, State of New York 
Keystone Junior College, La Plume, PA 
Leeward Community College, Honolulu, HA 
Los Angeles City College, Los Angetes, CA 
University of Minnesota Technical College. Crookston* Ml 
University of Missouri, Kansas City, MO 
Mid-America Nazarene College, Olathe, KS 
Mohegan Community College, Norwich, CN 
"Mount Hood Community College, Grosham, OR 
Community College of Philadelphia, Philadelphia, PA 
Piedmont Technical College, Greenwood, SC 
Pierce Junior College. Philadelphia, PA 
Pikevilie College, Pikevilie, KY 
Sacramento City College, Sacramento, CA 
Tnlon College. River Grove IL 

ERIC 



West Virginia State College. Charleston, WV 
University of Wisconsin - ta Crosse. Ca Crosse, Wf 
University of Wisconsin - Oshkosh. Oshkosh. Wl 
University of Wisconsin - Parkside. Parkstde. Wl 
Wrnsion-Safem State University. Winston-Salem. NC 



Number of program reports reviewed 
from postsecondary institutions ~ 34 
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APPENDIX II 



Characteristics of the Studies Reviewed 



Number of studies from community anC |tjmOr colleges 21 

Number ot studies from KvO-year technical colleges 2 

Number of studies from puhi*c colleges or universities 17 

Number of studies frOirt private four-year colleges 3 

Number of states represented in tbr£ study 19 

Number of gain s^o^e siudits reviewed 10 

number of GPA stupes reviewKl 14 

Number of rctn.ttiOn studies reviewed 14 

Number of miscellaneous studies reviewed 5 
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